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We establish the Bahadur representation of sample quantiles for 
linear and some widely used nonlinear processes. Local fluctuations of 
empirical processes are discussed. Applications to the trimmed and 
Winsorized means are given. Our results extend previous ones by 
f-H , establishing sharper bounds under milder conditions and thus pro- 

' vide new insight into the theory of empirical processes for dependent 

! random variables. 

1. Introduction. Let (£k)k£Z be independent and identically distributed 
(i.i.d.) random variables and let G be a measurable function such that 

(1) X n = G(... 

. is a well-defined random variable. Clearly X n represents a huge class of 

stationary processes. Let F(x) = f(X n < x) be the marginal distribution 
fT) ■ function of X n and let / be its density. For < p < 1, denote by £ p = 

inf{x : F(x) > p} the pth quantile of F. Given a sample X\, . . . , X n , let £ njP 
be the pth (0 < p < 1) sample quantile and define the empirical distribution 
^5 . function 

^ ■ 1 " 

+2 ■ F n (x) = - > lxi<x- 



=1 



For simplicity we also refer to £ niP as the pth quantile of F n . In this paper we 
. are interested in finding asymptotic representations of £ n ,p- Assuming that 

(Xj)fe g ^ are i.i.d. and > 0, Bahadur [1] first established the almost sure 
result 



(2) Up = Cp + P f f;fi } + O a .,[n- 3 / 4 (logn) 1 /2(loglogn) 1 ^], 
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where a sequence of random variables is said to be O a-Si (r n ) if Z n jT n is 
almost surely bounded. Refinements of Bahadur's result in the i.i.d. setting 
were provided by Kiefer in a sequence of papers; see [19, 20, 21]. In particular, 
Kiefer [19] showed that if /' is bounded in a neighborhood of £ p and /(£ p ) > 
0, then 



-3/4(loglogn)3/4 /(^ 



almost surely for either choice of sign. Recent contributions can be found 
in [4, 10]. 

Extensions of the above results to dependent random variables have been 
pursued in [26] for m-dependent processes, in [27] for strongly mixing pro- 
cesses, in [16] for short-range dependent (SRD) linear processes and in [17] 
for long-range dependent (LRD) linear processes. The main objective of this 
paper is to generalize and refine these results for linear and some nonlinear 
processes. 

Sample quantiles are closely related to empirical processes, and the asymp- 
totic theory of empirical processes is then a natural vehicle for studying their 
limiting behavior. There is a well-developed theory of empirical processes for 
i.i.d. observations; see, for example, the excellent treatment by Shorack and 
Wellner [29]. The celebrated Hungarian construction can be used to obtain 
asymptotic representations of sample quantiles (cf. Chapter 15 in [29]). 

Recently there have been many attempts toward a convergence theory 
of empirical processes for dependent random variables. Such a theory is 
needed for the related statistical inference. Ho and Hsing [17] and Wu [31] 
considered the empirical process theory for LRD sequences and obtained 
asymptotic expansions, while Doukhan and Surgailis [9] considered SRD 
processes. Instantaneous transforms of Gaussian processes are treated in [7]. 
Further references on this topic can be found in the recent survey edited by 
Dehling, Mikosch and S0rensen [6]. 

For dependent random variables, powerful tools like the Hungarian con- 
struction do not exist in general. To obtain comparable results as in the 
i.i.d. setting, we propose to employ a martingale-based method. The main 
idea is to approximate sums of stationary processes by martingales. Such 
approximation schemes act as a bridge which connects stationary processes 
and martingales. One can then leverage several results from martingale the- 
ory, such as martingale central limit theorems, martingale inequalities, the 
martingale law of the iterated logarithm, and so on, to obtain the desired 
results. Gordin [13] first applied the martingale approximation method and 
established a central limit theory for stationary processes; see also [14]. Wu 
and Woodroofe [37] present some recent developments. Several of its appli- 
cations on various problems are given in [15, 18, 31, 32, 34]. 
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Historically many limit theorems for dependent random variables have 
been established under strong mixing conditions. On the other hand, al- 
though the martingale approximation-based approach imposes mild and 
easily verifiable conditions, it nevertheless may allow one to obtain opti- 
mal results, in the sense that they may be as sharp as the corresponding 
ones in the i.i.d. setting. 

In this paper, for some SRD linear processes we obtain the following 
asymptotic representation of sample quantiles: 

Cn, P = Z P + P ~^ P) + Oa.s>- 3 / 4 (loglogn) 3 / 4 ] 

(cf. Theorem 1), which gives an optimal bound n -3 / 4 (loglogn) 3 / 4 in view 
of Kiefer's result (3) for i.i.d. random variables. Sample quantiles for LRD 
processes and some widely used nonlinear processes are also discussed and 
similar representations are derived. In establishing such asymptotic represen- 
tations, we also consider the local and global behavior of empirical processes 
of dependent random variables. 

We next introduce the necessary notation. A random variable £ is said 
to be in £«, q > 1, if ||£||, := [E(|£|9)] 1/5 < qq. Write || • || = || • || 2 . Denote 
the shift process = ( . . . , Ek-i, £fc) and the projection operator Vk£ = 
E(£|.Ffc) — E(£|J r fc„ 1 ), k G Z. For a sequence of random variables Z n , we 
say that Z n = o a . s .(r n ) if Z n /r n converges to almost surely. Write u n ~ b n 
if lim n ^ 00 a n /& n = 1. 

The rest of the paper is structured as follows. Pointwise and uniform 
Bahadur representations for SRD linear processes are presented in Section 2 
and proofs are given in Section 6. LRD processes and nonlinear time series 
are discussed in Sections 3 and 4, respectively. Applications to the trimmed 
and Winsorized means are given in Section 5. Section 7 contains proofs and 
some discussion of results presented in Section 3. 

2. SRD processes. A causal (one-sided) linear process is defined by Xj. = 
J2?^o a i £ k-ii where are i.i.d. random variables and are real coefficients 
such that Xfc exists almost surely. The almost sure existence of X n can 
be checked by the well-known Kolmogorov three-series theorem (cf. [3]). 
Let f e and F e be the density and distribution functions of e, respectively. 
Recall that F and F n are the distribution and the empirical distribution 
functions of X n and £ p is the pth quantile of F. Without loss of generality 
let ao = 1. Define the truncated process by X n ± = J2'j^=n-k a j £ n-j, k <n, 
and the conditional empirical distribution function by 

-. n n 
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Throughout this section we assume that 

(4) sup[/ E (aO + |£(z)|]<oo. 

X 

It is easily seen that (4) implies sup x [/(x) + < oo in view of the 

relation F(x) = K[F £ (x — J2iZi a i £ k-i)] and the Lebesgue dominated con- 
vergence theorem. Define the function £ q (n) = (log log re) 1 / 2 if q > 2 and 
£ q (n) = (log re) 3 / 2 (log log n) if q = 2. 

Theorem 1. LetX k = J2Zo a i £ k-i and assume (4), f(^ p ) > and E(|e fc | a ) < 
oo for some a > 0. 

(a) // 

oo 

(5) \a i \ mHa/q ' 1) = 0(log^ q re) 



i=n 



for some q > 2, then (i) there exists C > such that 5 nj q = C£ q (n)/[f(^ p )y/n] 
satisfies 

(6) F n {^ p + 5 nA ) >p>F n (£ p - 5 n! q) almost surely 

and \Cn.p — Cp\ < $n,q almost surely, and (ii) the Bahadur representation 
holds: 

(7) tn, P = e p + P "flf p) + Oa.s.fn-^aoglogre) 1 / 2 ^^)]. 
(b) // 

oo 

(8) Ytlair^ 2 ^ <0O > 

i=l 

i/ien (i) and (ii) m (a) hold for q = 2. 

Remark 1. If a = 2, then the process (Xk)k£Z has finite variance, and 
(8) implies that (X^^^z is short-range dependent since its covariances are 
summable. 



Remark 2. If a > 2 and there is a q > 2 such that (5) holds, then 
X^ n |oi| = 0(log _1 / Q re). The implication is clear if q < a. If q > a, then 

EZn \ a i\ a/q > (EZn \ai\) a/q and we also have J2Zn Kl = 0(log~ 1/a n). There- 
fore, in the case a > 2 it suffices to check (5) for the special case q = a in- 
stead of verifying it for a whole range of q > 2. The condition J2Zn \ a i\ = 
0(log™ 1 / a re) is fairly mild for a linear process being short-range dependent. 
For example, it is satisfied if a n = 0{n~ l log^ 1 " 1 /" re). 
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Assuming that E(|efc| Q ) < oo for some a > and that \a n \ = 0(n K ) with 
k > 1 + 2/a, Hesse [16] obtained the representation 

(9) tn, P = t P + P ~^ P) + O a . s .(n- 3 / 4 ^), 

JKSp) 

where 7 > [a 2 (8k — 5) + 2a(10K — 9) — 13]/(4«k — 2a — 2) 2 . In comparison to 
Hesse's result, our condition (5) only requires k > max(l, 2/a). If q > 2, then 

the error term (7) is B . B .[n- 3 / 4 (loglogn) 1 / 2 4 /3 (n)] = O a . s >~ 3/4 (loglogn) 3 / 4 ], 
which gives an optimal bound; see Kiefer's relationship (3). The bound is 
much better than the one in (9). For example, if a = 1 and n = 3.01, then 
Hesse's result (9) gives the error bound O a .s.( n_0 '° 031 ")• On the other hand, 
in Hesse's result £j does not need to have a density. 

Remark 3. It is unclear whether Kiefer's law of the iterated logarithm 
(3) can be extended to SRD processes. Our result only provides an upper 
bound. Kiefer's [19] proof involves extremely meticulous analysis and it de- 
pends heavily on the i.i.d. assumption. It seems that Kiefer's arguments 
cannot be directly applied here. 

Example 1. Suppose that is symmetric and its distribution function 
F e (x) = 1 — L(x)/x a , x > 0, where < a < 2 and L is slowly varying at 00. 
Here a function L(x) is said to be slowly varying at 00 if, for any A > 0, 
linia^oo L(Xx)/L(x) = 1. Notice that is in the domain of attraction of 
symmetric a-stable distributions. 

Assume that \a n \ = 0(n~ r ) for some r > 2/a. Then for q S (2, ra), (5) holds. 
In this case, E(|e| a ) = 2a f£° x~ l L(x)dx may be infinite. However, there 
exists a pair (a',q') such that E(|e| a ) < 00 and (5) holds for this pair. 
Actually, one can simply choose a' < a such that 2 < ra' and let q' = 
(2 + ra')/2. Then ££ n \ ai \ min ( a ' / q ' ^ = 0(ra 1 - m '/<f') with ra'/q'>l and 
E(|e| a ') < 1 + J™ F(\e\ a ' >u)du = l + 2a' J™ x a '~ a ~ l L{x) dx < 00. By The- 
orem 1 we have the Bahadur representation (7) with the optimal error bound 
O a . s .[n- 3 / 4 (loglogn) 3 / 4 ]. 

Theorem 1 establishes Bahadur's representation for a single p G (0, 1). The 
uniform behavior of £„ )P — £ p over p £ \po,pi], < po < p\ < 1, is addressed 
in Theorem 2. Such results have applications in the study of the trimmed 
and Winsorized means; see Section 5. Let i q (n) = (log n) 1 ^ (log log n) 2 l q if 
q > 2 and 12 (n) = (log n) 3 / 2 (log log n). 

Theorem 2. Let X k = J2Zo a i £ k-i- Assume (4), inf Po < p < Pl /(£ p ) > 
for some < po < pi < 1 and 

(10) sup \f'^{x) I < 00. 

x 



G 



W. B. WU 



In addition, assume that there exist a > and q>2 such that E( [£/%[") < oo 
and 



(11) Y,\ a i\ m ' m(a/q,1) < °°- 



i=l 



Then (i) sup po < p < pi \£ n , p - £ p | = o a . s .[t g (n)/- v /n] and (ii) i/ie uniform Ba- 
hadur representation holds: 

P-Fn{ip) 



(12) sup 

po<p<pi 



£,n,p £,p 



& . s .[n-^\i q {n)\ogn) 1/2 ]. 



Remark 4. Generally speaking, (12) cannot be extended to po = 
and/or p\ = 1. The quantity £ njP — £ p exhibits an erratic behavior as p — > 
or 1. The extremal theory is beyond the scope of the current paper. 

Remark 5. If eo has finite moments of any order, then under the con- 
dition Yli=i \ a i\ < °°> (12) gives the bound n~ 3 ' 4 (logn) 1 / 2+?? for any rj > 0. 

Remark 6. The Kiefer-Bahadur theorem asserts that for i.i.d. random 
variables the left-hand side of (12) has the optimal order n _3 / 4 (logn) 1 / 2 (loglog 
see Chapter 15 in [29]. Our bound n _3//4 (i g (n) logn) 1 / 2 is not sharp. The 
reason is that we are unable to obtain a law of the iterated logarithm for 
su P a <x<b \Fn(%) — F(x)\; see (54) in the proof of Theorem 2 in Section 6.5, 
where the weaker result sup a<x<fe \F n (x) — F(x)\ = o a . s .[i 9 (n) / \/n] is proved. 
On the other hand, in proving Theorem 1, we are able to establish a law of 
the iterated logarithm for F n (x) — F(x) at a single point x [cf. Proposition 1 
and (i) of Lemma 10], by which the optimal rate O a .s. [n~ 3 / 4 (log logn) 3 / 4 ] 
in (7) can be derived. 

3. LRD processes. Let the coefficients ao = 1, a n = n~^L(n), n > 1, 
where 1/2 < (3 < 1 and L is a function slowly varying at infinity; let = 
Y^A=o a i £ k-ii where are i.i.d. random variables with mean zero and finite 
variance. By Karamata's theorem (see, e.g., Theorem 0.6 in [25]), the co- 
variances 7 (n) = E(X X n ) ~ C /3 n 1 - 2 ^L 2 (n), where Cp = E(e|) / °° x"^(l + 
x)~@ dx, are not summable and the process is said to be long-range depen- 
dent. The asymptotic behavior of LRD processes is quite different from that 
of SRD ones. We shall apply the empirical process theory developed in [31] 
and establish Bahadur's representation for long-range dependent processes. 

Let tf n = V^J2k=i k^-^L^k) and 

< 13 » <HK,if~ (1 .;i. w ^w. 

By Karamata's theorem, ^ n ~ n 2 " 2 ^L 2 (n)/(3/2 - 2f3) if j3 < 3/4, * n ~ 
y/nL*(n) if /3 = 3/4, where L*{n) = Y^k=\L 2 {k) jk is also a slowly varying 
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function, and * n ~ ^££=1 & 1/2 ~ 2/3 L 2 {k) if /3 > 3/4. Let A n ((3) = ^ 2 (log n) (log log n) 
if p < 3/4 and A n (f3) = I- 2 (log n) 3 (log log n) 2 if > 3/4. 

Theorem 3. Assume infp <p< Pl /(£ p ) > for some < po < pi < 1, 
E(ef) < oo and 

(14) E 8U Pl/i°(^l+/ |/^(n)| 2 dn<cx). 

i=o x JM 

Lei 6 n = <r nj i(logn) 1 ' 2 (loglogn)/n. TTien 

p-F n fe) X 2 /% 



sup 

P0<P<Pl 

(15) 

= 



£n,p £p 



3 V^ n logn b ny /A n (/3) 



n re 



The three terms in the O a .s. bound of (15) have different orders of magni- 
tude for different (3, and correspondingly the term that dominates the bound 
is different. If (3 > 7/10, since 3/2-3/ 3 < -/3/ 2-1/4 and -/? < -(3/2 - 1/4, 
it is easily seen that 6 3 + b n \/ A n ((3) / n = o[y/ (6 n log n)/n] in view of ^ n = 
0[^/EL*(n) +n 2 - 2 f 3 L 2 (n)] and y/An(0) < 1y t (l ogn) 3 / 2 (loglo gn). Hence the 
dominant one in the bound of (15) is O a .s. [V (pn log re) /re] . On the other 
hand, if /3 < 7/10, then ^(6,, log n)/n = o[b ny /A n (/3)/n], b n y/A n (f3)/n ~ 
Cin 3 ( 1 / 2_ ^)-L 3 (n) (logn) (log logn) 2 and 6 3 ~ C , 2n 3 ( 1 ' /2_ ^L 3 (n)(logn) 3 / 2 x (loglogn) £ 
for some < C\,C2 < oo. So b n \/ A n ((3)/n = o(6 3 ). For the boundary case 
/? = 7/10, the situation is more subtle since the growth rate of the slowly 
varying function L is involved. In summary, noting that ^f n = 0[y/nL* (n) + 
n 2 ~ 2 ^L 2 (n)], the error bound of (15) is 

{ [„3(l/2-0 + n (V2~/3)/2 /n l/2 + n l/2-/3 (n l/2 + ^-2^ ^ {n)} 
= 0[n max(- / 3/2-l/4, 3/2-3/3) 

for some slowly varying function L\. This bound is less accurate than the one 
for the SRD or the i.i.d. counterparts since max(— (3/2 — 1/4, 3/2 — 3/3) > 
-3/4 if P < 1. If 3/4 < /3 < 1, then the bound is O^rT^-^L^n)]. See 
Section 7.1 for more discussion on the sharpness of (15) and (16). 

In comparison with Bahadur's representations (2) for i.i.d. observations or 
(7) for short-range dependent processes, (15) has an interesting and different 
flavor in that it involves the correction term ^X 2 f'{^ p )/f{^ p ). More interest- 
ingly, this correction term is not needed if (3 > 5/6, which includes some LRD 
processes. Actually, by Lemma 16 in Section 7, \X n \ 2 = o a , s ,(b 2 l ). Note that 
b 2 = o(y/b n log n/y/n) if (3 > 5/6. Then the correction term \X 2 f'{ip)/f{ip) 
can be absorbed into the bound y/b n log n/y/n. 
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If the dependence of the process is strong enough, then we do need 
the correction \X\f / for a more accurate representation. Specifi- 
cally, if p 6(1/2,5/6), then ^b n log n/^H = o^^/n 2 ), 6^ + 6 n /n = 
°( a n i/ n2 )> an d as the central limit theorem nX n /a n> \ N(0, 1) holds, the 
correction term has a nonnegligible contribution. 

4. Nonlinear time series. In the case that G may not have a linear form, 
we assume that G satisfies the geometric-moment contraction (GMC) con- 
dition. On a possibly richer probability space, define i.i.d. random variables 
e'j,£i t k, k G Z, which are identically distributed as £o and are independent 
of (ej)j£z- The process X n defined in (1) is said to be geometric- moment 
contracting if there exist a > 0, C = C(a) > and < r = r(a) < 1 such 
that for all n > 0, 

(17) E[|G( ...,£_i, e , ei, . . . , £„) - G( . . . , eLi, 4 £ 1; ... , £„)|<*] < C7r n . 

The process X' n := G(. . . , e'_ 1 , e' Q , e±, . . . , e n ) can be viewed as a coupled ver- 
sion of X n with the "past" JF = (...,£_i,£o) replaced by the i.i.d. copy 

= ( . . . , e^_i,£o). Here we shall use (17) as our basic assumption for study- 
ing the asymptotic behavior of nonlinear time series. Since (17) only imposes 
the decay rate of the moment of the distance \X n — X' n | , it is often easily ver- 
ifiable. In comparison, the classical strong mixing assumptions are typically 
difficult to check. Recently Hsing and Wu [18] adopted (17) as the underly- 
ing assumption and studied the asymptotic behavior of weighted U -statistics 
for nonlinear time series. 

Condition (17) is actually very mild as well. Consider the important spe- 
cial class of iterated random functions [11], which is recursively defined by 

(18) X n = G(X n -i,e n ), 

where G(-, •) is a bivariate measurable function with the Lipschitz constant 

, \ r \G(x,e)-G(x',e)\ 

(19) L £ = sup 1 v y , M < oo 

satisfying 

(20) E(logL e )<0 and E[L" + \x - G(x ,s)\ a ] < oo 

for some a > and xq. Diaconis and Freedman [8] showed that under (20) 
the Markov chain (18) admits a unique stationary distribution. Wu and 
Woodroofe [36] further argued that (20) also implies the geometric-moment 
contraction (17); see Lemma 3. Some recent improvements are presented 
in [35]. Under suitable conditions on model parameters, many popular non- 
linear time series models such as TAR, RCA and ARCH satisfy (20). Our 
main result is given next. 
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Theorem 4. Assume (17), sup x [f(x) + \f'(x)\] < oo and inf po < p < Pl /(£ p ) > 
for some < po < pi < 1 • Then 

P-Fn{Z P 



(21) sup 

p <P<Pl 



O a . s .(n- 3 / 4 log 3 / 2 n). 



Proof. For a fixed r > 2 let m = log raj , where u> = uo T is given in 
Lemma 1 and \t\ denotes the integer part of £; let 

(22) X k = G(... 

i £fc— m— 2,fcj ^fe— m— l,fe) ^fc- 



-2> • • • >£fc-i>£fcj- 



Our strategy is to replace the "past" T^-m = (. . . ,£fc_ m _i,£&_ m ) in A^, 
by the i.i.d. copies ( . . . , e k - m -2,k, e k - m -i,k, £k-m,k) so that (X fc ) fcG z is an 
m-dependent process. When X n is a linear process, Hesse [16] adopted a 
truncation argument which forgets the past Tk-m and approximates Xfc 
by G n (ek- m +i, ■ ■ ■ , £k-i, £fc) for some measurable function G n . Clearly the 
distribution function of G n (ek- m +i, ■ ■ ■ ,£&_!, £&) may be different from .F. 
Our coupling argument has the advantage that the marginal distribution 
function of X^ is still F. For j = 1, 2, . . . , m, let 



(23) F nJ (x) 



1 



1 + A n (j) 



A„(j) 



X-_l- <x and F n( x ) 



1 

n 



i=0 i=l 

where A n (j) = [ra/mj for 1 < j < n — m\n/m\ and A n (j) = \n/m\ — 1 
for 1 + n — m\n/m\ < j < m. Let A = A n = n/m and b n = c\/\og A/ \^A, 
where the constant c will be determined later. Let M n j(x) = F n j(x) — F{x) 
and M n (x) = F n (x) - F{x). Since \M n (x) - M n {y)\ < maxi<j< m \M n j(x) - 
M n j(y)\, by Lemma 2 there is a 5 T > such that 

SribnlogA) 1 / 2 ' 



(24) 



sup \M n (x) - M n (y)\ > 
\x~y\<b n 



A 1 / 2 



3=1 



sup \M nJ (x) - M nJ (y)\ > 
|u|<6„ 



<5 T (6 n log^) 



1/2 



A 1 / 2 



mO(A~ 



and similarly P[sup x |M n (x)| > 5 T y/logA/\fA] = mO(A~ T ). Since r > 2, m^" 
0[n~ T (logn) r+1 ] is summable over n. By Lemma 1 and the Borel-Cantelli 
lemma, we have 



sup \[F n (x)-F(x)]-[F n (y)-F(y)}\ 
\x-y\<b n 



(25) 



< sup \M n (x) - M n (y)\ + 

[as — y\<bn 

SribnlogA) 1 / 2 , 2C r logra 



2C T logn 



+ 
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and sup x \F n (x) — F(x)\ < 5 T ^log A/s/A + C T (n 1 logn) almost surely. Now 
in b n = cy/logA/y/A we choose c = (2 + 5 T )/[inf po < p < pi f(£ p )]- Then we have 

inf [F n {i p + b n )-p\ 

P0<P<Pl 

> inf [F(£ p + b n )-p]- sup \F n (£ p )-p\ 

P0<P<P1 P0<P<P1 

- sup \[F n (x)-F(x))-[F n (y)-F(y)}\ 

\x—y\<b n 



>b n inf f(C P ) + 0(b 2 n )-[S T V^g~A/v r A + C T (n- 1 log 
Po<p<pi 

- [Sr y/b n log A/VA + 2C T (n' 1 logn)] 



n 



> ^logA/VA 

almost surely. Similarly sup po<p<pi [F n (^ p — b n )—p] < almost surely. Hence 
for A n , p = £„ iP - £ p , sup po < p < pi | A„ iP | < b n almost surely since F n is nonde- 
creasing. Since |F n (£ njP ) — p\ < 1/n, by (25) 

sup - F(£ n ,p)] - [F„(£ p ) " 

P0<P<Pl 

= sup |[p--F(en, P )]-[F n (^)-F(^)]| + 0(l/n) 

P0<P<P1 



O; 



dribnlogA) 1 / 2 , 2C T log 



+ 



ylV2 n 
Oa.s.(n- 3/4 log 3 / 2 n), 



+ 0(l/n) 



which entails (21) in view of inf po < p < pi /(£ p ) > and, by Taylor's expansion, 
F(Cn, P ) ~ F($ p ) = A n , p /(e p ) + 0(Al >p ) since sup, \f'(x)\ < oo. □ 

Lemma 1. Assume (17) and sup x /(x) < oo. Then for any r > 1, i/iere 
ea;is£ uj t ,C t > stic/i £/ia£ /or to = [^V log raj we have 



(26) 



sup | F n (x) — F n (x) | > C T n 1 logn 



0(n" T ). 



Proof. Let p = r 



l/(2a) 



-(l + a- 1 )(r + 2)/logp and a = !-(! + 



a _1 )(r + l)/logp; let i? n be the set f]?=i{\^i ~ %i\ < P m } and let R' n be its 
complement. Then 

F(R' n ) < nF(\Xi -Xi\>p m )< np-^EdX, - X^) 



< np- am Cr m = nCp am = o(ra~ r ). 



BAHADUR REPRESENTATION 



11 



Let K = C T — 1. By the triangle inequality, to establish (26) it suffices to 
show that 



(27) 



sup | F n (x) - F n (x) | l Rn > Kn 1 log n 



0(n- T ). 



Notice that sup x \F n {x) — F n (x)\ln n < sup x [F n (x + p m ) - F n (x — p m )]. Clearly, 
the event {sup x [F n (x + p m ) — F n {x — p m )] > Kn -1 logn} implies that there 
exist two indices i and j with j — i> \_K log nj such that both Xi and Xj 
are in the interval [x — p m , x + p m ] for some j;£l. Therefore 

sup[F n (x + p m ) -F n (x- p m )} > Kn" 1 logn 



< 



n-\K log n\ n 

|J |J {|X i -X J |<2p m } 

i=l j=i+[K lognj 



n-L-fflognJ n 

< E m^-^i<2p m ) 

i=l j=i+lKlogn\ 
n 

<n J2 P(l^o-^|<2p m ). 

j=L_ftTlognJ 

Recall (17) for X' j = G(...,e , _ 1 ,e? ,ei,...,e j ). Then 
F(\X -X j \<2p m ) 

< P(|X -X 3 \< 2p m , \X 3 -X' j \<p>) + F(\Xj -X' j \> p>) 

< P(|X -X'j\< 2p m + p>) + p- aj Cr j . 

Observe that X and X'j are i.i.d. and F(\X -X' j \<5)= E[P(|X -X'^K 
< 2cS, where c = sup x f(x) < oo. Thus 



sup |F n (x) - F(x)\l Rn > Kn 1 log n 



j=[K log n\ 

= nO(np m + p Kl °z n ) + nO(p aKlosn ), 
which ensures (27) by the choice of K and u> T . □ 

Lemma 2. Let (Zk)kez be i.i.d. random variables with distribution and 
density functions F z and f z for which sup 2 f z (z) < oo; let F n>z {z) = ~ Ya=i ^Zi<z ■ 
Then for all r > 1 there exists C T > such that 



(28) 



sup|F n>z (x) -F z (x)\ > 



Crilogn) 1 / 2 



n 



1/2 
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and 



C T (b n log re) 
n i/2 



1/2 1 



P sup \F n>z (x) - F z (x) - {F ntZ (y) - F z {y)}\ > 



-\x-y\<b„ 



(29) 



0{n- r ) 



where (6 n ) n >i is a positive, bounded sequence of real numbers such that 
logn = o(nb n ). 

Lemma 2 easily follows from classical results for i.i.d. uniform random 
variables under quantile transformations; see the Dvoretzky-Kiefer-Wolfowitz 
inequality and Inequality 14.0.9 in [29]. The lemma is needed in the proof of 
Theorem 4 and it is a special case of Lemma 7 in Section 6.2. We purposefully 
state Lemma 2 here also for the sake of comparison: the martingale-based 
method may yield results comparable to those obtained under the i.i.d. as- 
sumption. 

5. Trimmed and Winsorized means. Let £n,l/n < £n,2/n < • ■ • <■ £n,l be 
the order statistics of X±, . . . , X n . Then the trimmed and Winsorized means 
are of the forms Efi„( n ) + i Cn,i/n/[P(n) - a(n)] and n~ 1 [a(n)^ n>a(n)/n + (n - 

W"))^(n)/n+i/n + Efia(„)+i Cn.t/n] > respectively, where a(n) = [np J and 
P(n) = [npi\ . 

Stigler [30] studied the asymptotic behavior of trimmed means for i.i.d. 
random variables. Here we shall apply Theorems 2 and 4 to obtain a central 
limit theorem for some dependent random variables. SRD linear processes 
and causal processes satisfying (17) are considered in (i) and (ii) of Theo- 
rem 5, respectively. Denote by N(fi,a 2 ) a normal distribution with mean [i 
and variance a 2 . 

Theorem 5. (i) Let q = 2 and assume that the conditions of Theorem 2 
are satisfied. Then there is a a < oo such that 



(ii) Assume that the conditions of Theorem 4 are satisfied. Then the cen- 
tral limit theorem (30) holds. 



(30) 





n< 
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It is easily seen that, under the conditions of Theorem 2, (12) also holds 
over the expanded interval [po — T >Pi + T ] f° r some sufficiently small r > 0. 
Therefore, we have sup a ( n ) /n < u <[ 1+( g (n )]/ n |£ n;W | = O a . s .(l) and consequently 



(31) 2^ £n,i/n~ n U,udu = O a . s .(l). 

i=a(n)+l J P° 

By (12) of Theorem 2, 



pi /-pi 



€n,udu- I Cudu- I JTTT^- du 
Po Jpo Jpo J\tu) 

(32) 

= Oa.s.[n- 3 / 4 (, 2 (n)logn) 1 /2]. 

Lemma 11 in Section 6.4 asserts that {■ v /n[i ? n (x) — F(x)], £ po <x< £ Pl } => 
{W(x), £ po < x < £ Pl } for some centered Gaussian process W in the Skoro- 
hod space D[£ P0 ,£ P1 ] [2]. By the continuous mapping theorem, (30) follows 
from (31) and (32). 

(ii) By Theorem 4 in [35], under the conditions (17) and sup x f(x) < oo, 
we also have the functional central limit theorem {y/n[F n (x) — F(x)], £ Po < 
x < £ Pl } => {W(x), £ po < x < £ Pl } for some Gaussian process W. So (30) 
holds in view of the argument in (i). □ 

Remark 7. Using the same argument, it is easily seen that for the Win- 
sorized mean n- 1 [a(n)^ rijQ(n)/n + (n - (3(n))£ n ^ {n)/n+1/n + £fia( n )+i €n,i/n]> 
we also have the central limit theorem (30) with the asymptotic mean 
(Pi - Po)" 1 Ipo £« du replaced by p £ po + (1 -pi)£ pi + f*£ £ u du. Other forms 
of linear functions of order statistics can be similarly handled. 



6. Proofs of Theorems 1 and 2. We first introduce our method. Re- 
call J r k = (.. . ,£fe_i,e fc ) and F*(x) = £™ = i F £ (x - Xu^/n. Write F n (x) - 
F(x) = M n (x)+N n (x), where M n (x) = F n (x)-F*{x) and N n (x) = F*(x) - 
F(x). 

Notice that under (4) the conditional empirical distribution function F* is 
differentiable with the uniformly bounded derivative f^{x) = n~ l Ya=i fe{ x ~ 
Xi ; i-\) and hence dN n {x)/dx = /^(x) — f(x) is also uniformly bounded. The 
differentiability property greatly facilitates the related analysis. In compar- 
ison, F n is a step function and hence discontinuous. On the other hand, 
nM n (x) forms a martingale with bounded, stationary and ergodic incre- 
ments lxi<x — ^0-Xi<x\3~i—i) . Therefore, results from martingale theory 
are applicable. 

The martingale part M n and the differentiable part N n are treated in Sec- 
tions 6.2 and 6.3, respectively. Section 6.4 discusses the oscillatory behavior 
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and some asymptotic properties of empirical processes, which are needed for 
the derivation of Bahadur's representations. Proofs of Theorems 1 and 2 are 
given in Section 6.5. 

6.1. Some useful results. The following Proposition 1 is needed in prov- 
ing Theorems 1 and 2. See [33] for a proof. 

Proposition 1. Let S n (g) = X^Li^C^)? where g is a measurable func- 
tion such that g{J-o) S C q for some q>2, E[p(J-q)] = an d 

oo 

(33) @ 0jq :=J2\\'Pog(J r i)\\ q <oo. 

i=0 

Let B q = 18q 3 / 2 (q - l) 1 / 2 if q > 2 and B q = l if q = 2. Then 

(34) \\Sn(s)\\q<BqVn& Q , g . 

Furthermore, if 9 m>(? := \\Vog(^i)\\q = 0[(logm)- 1 / q ] for some q>2, 

then 

(35) lim sup dh ^" =£= = a 

\J2n log log ra 



n— too 



almost surely for either choice of sign, where a = \\ Z^o^o^C^)!! < °°- 

In order to apply Proposition 1 to S n (g) = n[F n (x) — F(x)] or n[f*(x) — 
f(x)], one needs to estimate ||'Polx j <a:|| or \\Vof e (x — Xj.j_i)||. The following 
Lemma 3 provides a simple upper bound if the random variable £o satisfies 
certain moment conditions. In particular, £q is allowed to have infinite vari- 
ance. 

Lemma 3. Let = J2iZo a i £ k-i, where are i.i.d. with K(\ek\ a ) < oo 
for some a > 0. Then under (4), \\Vog(F n )\\ q = 0[\a n \ mh < a l q ^\ holds for 
gi^n) = lx„<x and g{F n ) = fe(x - X ni7l _i). // additionally (10) is satisfied, 
then the same bound also holds for g(Fn) = f' £ {x — X n ^ n -\). 

Proof. Let (e^)igz be an i.i.d. copy of (ei)jgz and X* = X n — a n £o + 
a n e' ; let G n be the distribution function of X n — X n p = 2j=o a j £ n-j- Since 
c = sup x f £ {x) < oo, it is easily seen that the density g n (x) = G' n (x) is also 
bounded by c. Observe that F(X* < x\Fq) = ^(X n < x\F-i). By Jensen's 
inequality, 

||7Wn)|| 9 < WHXn < x\F ) - ¥(X* < x\F )\\ q 

= WK[G n (x - X n>0 ) - G n (x - X nfl + a n e - a n £o)|.Fo]||g 
< \\G n (x - X nfi ) - G n (x - X nfl + a n e - a n £o)|| g 
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<\\mm(c\a n e - a n e' \, l)\\ g 
<[E(c\a n e -a n e' \r in ^] 1/q 
= 0[\a n \ minia/q '% 

Here the elementary inequality [min(|6|, 1)]« < |6| min ( Q ' 9 ) is applied. The 
other cases g{T n ) = f e (x - X njn _i) and g(jF n ) = f' e (x - X„ jn _i) can be sim- 
ilarly proved. □ 

To establish a uniform Bahadur representation for £ njP — £ p over p G 
[po>Pi]> < po < Pi < 1; w e need the following version of maximal inequality, 
which will be used to obtain an almost sure upper bound of sup^ p < X <^ P1 \F n (x) ■ 
F(x)\. Similar versions appeared in [2, 22, 24, 28]. For a proof of Lemma 4 
see [33]. 

Lemma 4. Let (Yfc,0, k S Z)e e e fee a c/ass of centered stationary processes 
in C q , q > 1. Namely, for each 8 £ 0, (Yfc,6»)fcez *s a stationary process in C q 
and E(Yjfc #) = 0. Ze£ S^e = ^1,0 + • • ■ + a^d tei d = d(n) 6e an integer 
such that2 d ~ l < n < 2 d l Then 



6»gG 



(36) E* max sup 1 5 fc | 9 \ <V2^« E 
I L^eee J J ~^ I 

where E* zs i/ie outer expectation E*Z = inf{EX:X > Z, J is a random 
variable} . 

6.2. T/ie martingale part M n . 

Lemma 5. Let (b n ) n >i be a positive, bounded sequence of real numbers 
such that log 3 n = o(nb n ) . Assume sup^ f e {x) < 00. Then for any r > 1 there 
exists a constant C T > such that 

pi sup max n| M n (z + tt) - M n (x) | > C T J 2 k b 2 k log k \ 

tn<b 2k 2k ~ 1<n ^ 2k > 

(37) 

V ; =0(k~ T ). 

Proof. Let c = sup x f e (x) < 00. For a given u > 0, since P(x < X < 
x + ulJ-'i-i) < cu, we have 

n 

^2[E(l x<Xt < x +u\Fi-i) -E 2 (l x< x I <x+n|-^.-i)] < ncu. 
1=1 

Here without loss of generality we restrict u to be nonnegative. Let i& = 
2 fc 6 2 * logfc. Since l x <Xj<aH-u -E(l :r< x 1 < a: +«|-^ : i-i), 1 < i < n, form bounded 
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martingale differences, by Preedman's inequality (cf. Theorem 1.6 in [12]) 
we get that 



(38) 



max n\M n (x + u) - M n (x)\ > Ct k 

2 fc - 1 <n<2 fe 



< 2exp[-C 2 t|/(2Ci fc + 2 x 2 k cu)] 

for all C > 0. Let a k = b 2 k /k, U\ = ia k , i = 0, 1, . . . , k— 1, and v m = mb 2 k / {k2 k ), 
m = 0, 1, . . . , 2 fc — 1. Since t k = o(2 k b 2 k/k), we have for sufficiently large k 



that 



(39) 



D < max max n\M n (x + m) — M n (x)\ > Ct k r 

t0<i<fc-l2 fe -!<n<2 fc J 

fc-1 r , 

<VP max n\M n {x + Ui)-M n {x)\>Ct k \ 

~L L2 fc - 1 <n<2 fc J 



< 2k exp 



-C 2 log£; 



2c + 1 



and similarly 

f\ max max n|M n (x + v m ) - M n (x)\ > Ct k \ 

[0<m<2 k -l2 k - 1 <n<2 k ) 



(40) 



2 fc -l 

< £ 2exp[-C7 2 t2/(2Ct fc + 2 x 2 fc c« m )] 
m=0 

2 fc -l 

< 53 2exp[-C 2 t|/(2Ct /c + 2 x 2 k cv 2 k)] 



m=0 



< 2 fc+1 exp 



-C 2 fclog£; 



2c + 1 



For any v , v m < v < v m +i, observe that < F*(x + v rn +\) — F*{x + v m ) < 
cb 2k /(k2 k ), 

M n (x + v)- M n {x) <M n {x + v m+1 ) - M n (x) + cb 2k /(k2 k ) 

and similarly, M n (x + v) - M n (x) > M n (x + v m ) - M n {x) - cb 2 u j(k2 k ). So 
(40) yields 



(41) 



A sup max n\M n (x + v) - MJx)\ > (C + l)t k \ 

i0<v<a k 2 k - 1 <n<2 k ) 

-C 2 k\ogk- 



< 2 k+1 exp 



2c + 1 
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Since (41) holds for all x £ R, by the triangle inequality, (41) together with 
(39) implies 

pj max max n\MJx + it) - MJx)\ > (2C + l)t k \ 
[o<u<b 2k 2*-i<n<2fc J 

< P<^ max max n|M n (x + m) - M n (x)\ > Cth > 

[0<i<k-l2 k - 1 <n<2 k J 

fc-1 , 

+ y^P< sup max n\M n {x + v + Ui) — M n {x + Ui)\ 

[o<v<a k 2 k - 1 <n<2 k 

>(C+l)t k \ 



< 2k exp 



-C 2 logfc 
2c + 1 



+ fe x 2 k+1 exp 



-C 2 fclog£; 



2c + 1 



Therefore (37) follows by letting C T = 1 + 2(r + l) 1 / 2 (2c + l) 1 / 2 . □ 

Lemma 6. Assume that the conditions of Lemma 5 are satisfied and in 
addition assume that there is a p > 1 suc/i i/iaf /or a// sufficiently large n we 
have that 

b2n 



(42) 

Then for each fixed x S R, 



< min 6,- < max < po2„. 

P n<j<2n J n<j<2n J 



(43) 



sup \M n (x + u) -M n (x)\ =O a 

\u\<b n 



yjb n log log 



Proof. Observe that due to (42), for all sufficiently large n we have 
/nsup| u i <b \M n (x + u) - M n (x)\ 



max 

2 k - 1 <n<2 k 



v^, log log n 

n|M„(x + «)-M n (ac)| 



< sup max 

M<PV 2 fc -!<n<2fe V™n log log U 



< 



sup 



max 



n\M n (x + u) -M n {x)\ 



H<pb 2k 2 k -i<n<2 k ^2 fc -V -1 &2* log log 

Hence (43) follows from Lemma 5 via the Borel-Cantelli lemma. □ 

Lemma 7. Assume (4) and i/iai E(|A"i| a ) < oo for some a > 0. T/ien 
/or all t > 1 there exists C T > stic/i i/iai 

aOogn) 1 ^- 



(44) 



sup|M n (x)| > 



n 



1/2 



0(n" r ) 
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and 

(45) P 



sup \M n (y) - M n (x)\ > a 



bi /2 (logn) 1 / 2 



n 



1/2 



0(n" T ) 



■\x—y\<b„ 

where (6 n ) n >i is a positive, bounded sequence of real numbers such that 
logn = o(nb n ). 

Proof. We only prove (45) since (44) can be similarly proved. Let 
c = sup^, f e (x) < oo, v n = \Jnb n logn, i n = u n /n, J = n ( - T+4l ^ a and li(x) = 
lXi<a: -®(lXi<x\Fi-i)- Then 



sup |M n (y)-M n (x)| >Ct n 
\ x ~ y\<b„,x<— J 

sup |y!( y )-yi(x)| >ct n 

\x— y\<b n ,x< — J 



< n(Ct n )~ 1 E 
= 0(nt- l )E 



sup |yi(y)-Yi(x) 

\x—y\<b n ,x< — J 



sup |y(ic) 
ie<— J+b„ 

= 0(n 2 O(J - 6 n )- Q E(|X!r) = 0{n- l ~ r ), 
where Markov's inequality is used in the second inequality. Similarly, 



III n := P 



sup |M n (y)-M n (x)| >Ct n 

\x—y\<b„,x>J 



0(n-'- T ). 



Let Xj = ib n /n, i = —N — 1, . . . ,N + 1, where iV = [J^/^nJ > and 
//„ : = P sup \M n (y) - M n (x)\> Ct r 

-\x—y\<b„, — J<x<J 

Again by Freedman's inequality, for \x — y\ < b n and sufficiently large n, 
F[n\M n (y) - M n {x)\ > Cv n ] < 2exp[-C 2 v 2 J(2Cv n + 2ncb n )] < 2n~ c " '< 'V c+1 \ 
Thus 

max n\MJxi) - MJ Xj )\ > Cv n ] = 0(iV 2 )n~ C2/(2c+1) - 

i,j=-N-l,...,N+l:\xi-Xj\<b n 

For any x,y with \x — y\ < b n , \x\ < J and \y\ < J, choose i and j such that 
Xi < x < Xi + \ and Xj <y < Xj + \. Then 

n[M n { Xj ) - M n (x i+ i)] - 2cb n < n[M n {y) - M n (x)] 

< n[M n (x j+l ) - M n (xi)\ + 2cb n . 
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Therefore (45) follows by choosing C% = (2c + 1)[(8 + It) I a + r + 5], given 
that 

p{ sup \M n (y) - M n (x)\ > {C T + l)t n ) < I n + //„ + III n 

l\x-y\<b n > 

by the triangle inequality. □ 

Remark 8. In Lemmas 5-7 it is not required that b n — > 0. We shall use 
this fact to derive (54), which is a key step in proving Theorem 2. 

Remark 9. It is worth noting that Lemmas 5-7 also apply to LRD pro- 
cesses. In Section 7 we will use them to prove the Bahadur representation for 
LRD processes. For i.i.d. random variables the increments of the empirical 
and quantile processes are discussed in great detail in [5]. 

6.3. The differentiable part N n . 

Lemma 8. Let b n —* 0. Assume (4) and E(|efc| Q ) < oo for some a > 0. 
Further assume (5) if q > 2 or (8) if q = 2. Then 

(46) sup \N n (x + 1) - N n (x)\ = M^ 0as + O a . s .(&n)- 

|t|<6„ V n 



Proof. Let c = sup x \f' E {x)\ and recall f*(x) = dF*(x)/dx. Clearly \ f'{x)\ < 
Co since f'(x) = ~E[f' £ {x — X^i-i)}. Using Taylor's expansion, we get 

sup \N n {x + 1) - N n {x) - t[f*(x) - f(x)}\ < f su V \d[f*(x) - f{x)]/dx\ 

\t\<b n ^ x 

< b 2 n c . 

Let S n (x) = n[f*(x) — f(x)]. If q > 2, by (50) of Lemma 10 there exists 
C < oo such that limsup rwoo | S n (x) \ / v / 2n log log n < C < oo almost surely. 
Hence (46) follows. The case that q = 2 similarly follows from (ii) of Lemma 10. 
□ 

Lemma 9. Assume (4), (10) and (11). Then for any —oo <l <u < oo, 
we have 



(47) E 
and 



mi«(|JV B (x)|« + |<(x)|«; 

Kx<u 



(48) sup [|iV n (x)| + \K(x)\] =o a . s .[^(n)/v^]. 

x£[l,u] 
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Proof. We only consider q > 2 since the case q = 2 can be similarly han- 
dled. By Lemma 3 and (34) of Proposition 1, (11) entails maxi< x < u \\N n (x)\\ q = 
0(1/ y/k) and maxKaKu \\K(x)\\ q = 0(1/ y/n). Since N n (x) = N n (l) + \ x N' n (t) dt , 



E 



max \N n (x)\ q 

Kx<u 



0{E[|iV n (Z)|9]} + 0|E y \K(x)\dx 

0(n~ q l 2 ) + o\(u - l)K \N' n (x)\ q dx 
0(n~ q/2 ). 



Similarly, 



E 



max \N' n (x)\ q 

1<X<U 



0(n~ q ' 2 ). 



Then (47) follows. Let G n (x) = n[F*(x) - F(x)\. By Lemma 4, (47) implies 
that 



E 

k=A 



E[max n<2fc maxK,^ \G n (x)\ q ] « O[E* =0 2 M/9 2^p 



2i k / 2 4(2 k ) 



E 



2#/24(2fe) 



fc=4 
oo 



fc=4 
oo 



O(l) 

E - ■ - 



fc=4 



fc(log /c) 2 



Then by the Borel-Cantelli lemma, majq<a;< u |G n (x)| = o a . s . [i g (n)i/n], which 
in conjunction with the similar claim max;< x < M |G^(x)| = o a . s \i q (ri)y/n\ en- 
tails (48). □ 

6.4. Limit theorems for F n — F . 

Lemma 10. (i) Assume (4) and (5) for some q > 2. Then for every x 
there exist < o~\ , o~i < oo such that 



^[F n (x) - F(x)) 
hmsupi- — _ = <Ji 

n-+oo v 2 log log n 



(49) 
and 
(50) 

n-^oo v 2 log log n 

almost surely for either choice of sign. 

(ii) Assume (4) and (8). Then for every x 

(51) | F„(x) - F(i)| + UZ( X ) - f(x)\ = o„.[< 2 (n)/^]. 
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Proof, (i) It is a direct consequence of (35) of Proposition 1 and Lemma 



3. 



(ii) Let R n {x)=n[F n (x)-F(x)]. By (8) and (34) of Proposition 1, \\R n (x) 
0(y/n). Then by Lemma 4, 



E 

fc=4 



E[max, 



n<2 k 



\R n {x) 



2 k i 2 2 {2 k ) 



E 

k=4 

oo 

E 

fc=4 



OEi=o2 {fc - i)/2 2 J '/ 2 ] 2 
2 k k s (logk) 2 



0(k 2 2 k " 



2 k k 3 (logk) 



2 <OC, 



which entails |i? n (x)| = o aiSi [£2( re )"\Ai] by the Borel-Cantelli lemma. That 
\fn( x ) ~ f( x )\ = o a .s.[^2(n)/Vn] similarly follows. □ 



Lemma 11. Let q = 2 and assume that the conditions of Theorem 2 are 
satisfied. Then {^/n[F n (x) - F(x)], £ Po < x < £ Pl } {W(x), £ po <x< £ Pl } 
for some centered Gaussian process W in the Skorohod space -D[£ po ,£ Pl ]. 

Proof. It suffices to verify the finite-dimensional convergence and the 
tightness [2]. By Lemma 3 ||"Polx n <a;|| = 0[|an| mm ^ 2,1 ^]> which is summable 
in view of (11) since q = 2. Then by the Cramer-Wold device, the finite- 
dimensional convergence easily follows from Lemma 3 in [31]. 

Write I = £ Po and u = £ Pl . Recall F n (x) — F(x) = M n (x) + N n (x). To show 
the tightness of {y/n[F n {x) — F{x)\, I < x < u}, it suffices to show that both 
{y/nN n (x), I < x < u} and {^/nM n (x), I < x < u} are tight. The former 
easily follows from 



E 



sup n\N n (x) - N n {y)Y 

\x—y\<8,l<x,y<u 



< S 2 nE 



sup \t n (e)-f(e)\ 

K9<u 



<C5 2 



in view of (47) of Lemma 9 with q = 2. For the latter, let d{ = l x <Xi<y — 
E(l a< x i <vl^t-i), I < x < y < u. Then by (4) E(d?|^_i) < C(y - x). Here 
C denotes a constant which does not depend on n, x and y and it may vary 
from line to line. By Burkholder's inequality [3], 

2 



E[n 2 \M n (x)-M n (y)\ 4 ]< 



C 



n- 



i=i 

n 

^K 2 -E(d 2 |^_!)) 

1=1 



c 

< — 

<^\\di-E(di\F )\{' 
c 

< -{y-x) + C{y 
n 



+ -^l|E(df|^_i; 
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See inequality (48) in [31] for a similar claim. Therefore, by the argument 
of Theorem 22.1 in [2], pages 197-199, the process {^/nM n (x), I < x < u} is 
tight. 

□ 

Remark 10. Under conditions of the type given in (8), Wu [32] ob- 
tained a central limit theorem for S n (K)/y/n, where S n (K) = Y^l = i[K{Xi) — 
KK(Xi)], if is a measurable function and e$ may have infinite variance. 

Lemma 12. Let = Ya^o a i £ k-i an d assume (4) and E(\sk\ a ) < oo for 
some a > 0. Further assume (42) and log 3 n = o(nb n ). 

(i) If (5) holds with q > 2, then for every fixed x, 

sup \F n (x + u)- F{x + u)- [F n (x) - F(x)]\ 



Oa.sXVfrnloglogra) O a . s .[bJg(n)] 2 , 
+ 7= + ^a..s.\P ni 



\u\<b n 

(52) 

_ <^a.s.lV0^ 

(ii) 7/ (8) holds, then we have (52) with q = 2. 

Remark 11. The second term O a ,. s .[b n £ q (ri)]/ 'y/n in the bound of (52) 
is needed only when q = 2. 

Lemma 12 follows from Lemmas 6 and 8 and it provides a local fluctuation 
rate of empirical processes for linear processes. The last two terms of (52) 
are due to the presence of dependence, in the sense that they disappear if 
Xk are i.i.d. Actually, if Xi are i.i.d., then F* = F and hence N n = 0. 

Lemma 13. Assume (4), (10) and (11). Then under the conditions of 
Lemma 7, we have for any — oo < I < u < oo that 

sup \[F n (x)-F(x)]-[F n (y)-F(y))\ 

\x— y\<b n , x,y£[l,u] 

(53) 

[ yjb n log n b n i q (n) 



n \ n 



Proof. By Lemma 7 it suffices to show that 

sup \[Fl{x)-F{x)\-\F* n {y)-F{y)\\<b n sup \f*(9)-f(8)\ 

\x—y\<b n , x,y£[l,u] 0G[l,u] 

= Ko a . s .[iq(n)/y/n], 

which is an easy consequence of Lemma 9. □ 
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6.5. Proofs. 

Proof of Theorem 1. We only consider q > 2 since the case q = 2 
follows along similar lines. 

(i) Let 

°n — °~n,q- Then (42) holds. By Lemma 12 there exists a constant 
C\ < oo such that 

I [Fn^p + b n ) - F(Z P + b n )} - [F n (Q - F(Q}\ < C ly /(b n log log n)/n 

almost surely. Observe that F(^ p + b n ) = F{^ p ) + b n f{^ p ) + 0(b^) in view 
of (4) via Taylor's expansion. By (i) of Lemma 10, there exists a constant 
C2 < oo such that n\F n {^ p ) — F{^ p )\ < C2y/nl q (n) almost surely. Choose 

C > such that C - C 2 - CxJc/ffa) > 1, namely, C > [C^/JJ^) + 

V / ^i7/fe)+4(l + C' 2 )] 2 /4. Then for b n = C£ q (n)/[f(Q^\, F n ,(£ p + b n ) > 
p holds almost surely. The other statement that p > F n (^ p — b n ) almost 
surely similarly follows. Let A n = £ njP — £ p . Since F n is nondecreasing, by 
(6) |A n | < b n almost surely. 

(ii) The argument for Theorem 4 can be applied here. Applying Lemma 
12 with x = £ p , we have 

\F n ^n >P ) ~ F(£ p + A n ) - [F n (Q - F(£ p )]\ = O a . s .[^/(b n log\ogn)/n]. 

Notice that |-F n (£„ jP ) — p\ < 1/n and, by Taylor's expansion -F(£ p + A n ) = 
p + A n f(£ p ) + O(Al) since sup z \f'(x)\ < oo. Then 

A„/(£ p ) =p- F n (Q + O a . s . [yj(b n log log n)/n] 
and it entails (7). □ 

PROOF of Theorem 2. Let I = £ po and u = £ Pl . By Lemma 6 and (48) 
of Lemma 9, we have 

sup \F n (x) - F(x)\ < sup \F n (x) - F*(x)\ + sup \F*(x) - F(x)\ 

xG[l,u] x£[l,u] x£[l,u] 



' Vlog log n ' 


+ Oa.s. 


\(n)" 




~L q {n)~ 




= O a .s. 


y/n 




. y/n _ 




. y/n . 



Let b n = i q {n)l^fri. (i) By Lemma 13, 
inf [F n (x + b n )-F(x)} 

1<X<U 

> inf [F(x + b n )-F(x)] 

1<X<U 

- sup \F n (x) - F(x)\ 

1<X<U 
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sup \[F n (x)-F(x)]-[F n (y)-F(y)}\ 

\x—y\<b„, l<x,y<u 

>b n inf f(£ ) + 0(b 2 n ) + o a . s Xb n ) 

po<pu 

+ O a . s .[y / 6 n (logn)/n + b n L q (n)/y/n]. 

Hence mi{F n (x + b n ) — F(x) :l < x < u} > almost surely, which implies 
(i) together with a similar claim that sup{F n (x — b n ) — F(x) : I < x < u} < 
almost surely. The representation (12) then follows from Lemma 13 by using 
the same argument as in the proof of (ii) of Theorem 1 . □ 



7. Proof and the sharpness of Theorem 3. In the study of LRD pro- 
cesses, the asymptotic expansion of empirical processes plays an important 
role [17, 31]. Let U n>r = Eo<h<-<> IILi a js £ n-j a , U nfl = 1. For a nonneg- 
ative integer p, similarly to (4) in [31] let 



S n (y;p) = Yl 



i=l I 



l(X i <y)-J2(-l) r F^(y)U i! 



see also [17]. The quantity S n (y;p) can be viewed as the remainder of the 
pth-order expansion of F n (y). In our derivation of Bahadur's representation 
for LRD processes, we only deal with p = 1 and do not pursue the higher- 
order case p > 2 since it involves some really cumbersome manipulations. 



As in [31], let 9 n 



\a n -i\ 



\a n -i 



E?=i Ou E n = nQl + YZii^n+i-Qif. Since p = 1, 9 n = 0[\a n - 1 \ x (J2i= n -i « 
Recall that * n = V™ELi k 1 / 2 - 2 ? L 2 {k), A n ((3) = ^(logn) x (loglogn) 2 if 
(3 < 3/4 and A n {(3) = ^(logn) 3 (loglogn) 2 if > 3/4. Let H n (y) = n[F*(y) - 
F(y)+f(y)X n ] and h n (y) = dH n (y)/dy. 

Lemma 14. Assume E(e^) < oo and 

(55) sup|/ B (x)| + sup \f&)\ + / \fUu)\ 2 du<cv. 

x x JR 



2)l/2]_ 



Then 
(56) 



sup|H n (y)| 
y 



+ 



sup|/i n (y)| 
y 



0(*n). 



Proof. Let I = j R \f' £ {u)\ 2 du and^(i) = [f e (0 - x) - / e (0)]/V7. Then 
kg(x) = dKg(x)/dx = —fg(6 — x)j\fl satisfies J* K kg(x) dx = 1. Hence for all 
0, 

Kg G /C(0) := \K{x) = £ g{t)dt: J^g 2 {t) < l|; 
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sec [31] for the definition of the class KL. By Theorem 1 in [31], for 



S n (K e ,l) = ^=Y.[fe(e-X t ^ 1 ] 



/(0) + /'(0)X M _i] 



we have 



E 



sup5^(K ,i; 



0(H n ). 



Notice that S n (K ,l)yfl ~ KiP) = -/'(*) XSUe*- Then || supj^(y)||| = 

since sup e < oo and || X^=i -^t,t— l — n ^n|| = 0(y/n). By Karamata's 

theorem, it is easily seen that H n = O^ 2 ) (cf. Lemma 5 in [31]). Similarly, 

|| sup y \H n (y)\ || = 0(r.l/ 2 ) holds under the condition J R f 2 {u) du < oo. The 
last inequality trivially holds since s\xp u f £ (u) < oo. □ 

Lemma 15. Assume E(ef) < oo and (55). 

(i) Ze£ (5 n ) n >i be a positive, bounded sequence such that logn = o{n5 n ). 
Then 

(57) sup \S n (y- 1) - S n (x; 1)| = G\. s . [y/n5 n logn + M£ /2 (/3)]. 

|a?-y|<5n 

1 /2 

(ii) For any -oo < I < u < oo, snpi< y < u \S n (y; 1)| = o a . s .[A/ (/?)]• 



Proof, (i) By Lemma 7, since E(X 2 ) < oo, \Znsup\ x _ y \ <Sn \M n (y) - 
M n (x)\ = Oa.sXV^nlogn). To show (57), notice that sup| :r _ 2/ |< 5n \H n (y) - 

1/2 

H n (x)\ < 5 n sup e \h n (9)\; it suffices to verify that sup e \h n (6)\ = o a . s .[A/ {0)\ 
in view of 

(58) S n (y; 1) - S n (x; 1) = n[M n {y) - M n (x)] + [H n (y) - H n {x)\. 

By Karamata's theorem, J2j=o 2 (d " i)/2 ^ 2 i = O(* 2 <0 if P < 3/4 and £^ =0 2( d -^')/ 2 *^ 
0(d$ 2 d) if /? > 3/4. So it follows from Lemma 14 that 



J2 

3=0 



sup\h 2 j(y)\ 
y 



j=0 



Q[^ 2 (I)] 
dV 2 logd ! 



which in conjunction with Lemma 4 implies 



1 



E 



max sup \hj(y)\ 2 

j<2d y 



J^Oid' 1 log' 2 d) <oo. 



d=3 



Hence sup v \h n (y)\ = o a . s \sJ A n {f3) ] via the Borel-Cantelli lemma. 
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(ii) Notice that S n (y; 1) = nM n (y) + H n (y). By Lemma 7, 



n sup \M n (y)\ = O a . s .(\/logn). 



Using the argument in (i), (56) implies sup^ \H n (y)\ = o a . s \y/ A n ((3) ]. Hence 
(ii) follows in view of yfn = 0(^f n ) and y/ n log n = o[y/ A n (f3) ]. □ 

Lemma 16. Assume E(e|) < oo and (55). Lei B n = o" rii i(logn) 1 / 2 (loglogn), 
b n = B n /n and A„ iP = £ njP - £ p . Then (i) X n = o a . s .(6 n ) a^d (h) «/, in addi- 
tion, inf Po <p< pi f(€ p ) > for some < po < p\ < 1, we Ziaue 

(59) 

and 
(60) 



SUp |A„ jP | = O a .s.(6 n ) 

P0<P<Pl 



sup |A n|P -X„ 

p <P<Pl 



Oa.s.(^)+O a . s .[n- 1 Ay 2 (/?)]. 



PROOF, (i) Let S n = E?=i^i- Since £7 n ,i = ||5„|| ~ Cn 3 / 2 ~' 3 L(n), by 
Lemma 4 

-i 2 



B. 



2'l 





2 


max Si 

i<2 d 


< ^ 



d 

Lr=0 



^2( d - r )/ 2 f T 2 ,, 1 



0(d _1 log-^d). 



Again by the Borel-Cantelli lemma X n = o a . s .(6 n ). 

(ii) Similarly as in the proof of Theorem 1, it suffices to show that, due to 
the monotonicity of F n , infp <p< pi [F n (£ p + b n ) — p] > holds almost surely 
since the other inequality sup, 
derived. By Lemma 15 



po<p<pi i F n(C P -b n )-p]<0 can be similarly 



inf [F n (Z p + b n )-p] 

PO <P<Pl 

> inf [F(Z P + b n )-f(Z P + b n )X n -p + S n (Z P ;l)/n] 

P0<P<Pl 

- sup \S n (y;l)-S n (x;l)\/n=:I n + II n . 

\x-y\<b n 

Since sup,,, \ f^(x)\ < oo, by Taylor's expansion sup p \F(£ p + b n ) — p — b n f(£ p )\ = 
0{b 2 n ) and sup p \f(£ p + b n ) - =0(b n ). Let I = £ po &ndu = £ Pl . By (ii) of 

1/2 — 

Lemma 15, supi <x<u \S n (x; 1)| = Oa.s.K 7 (/?)]• By (i) X n = o a . s .(6n). There- 
fore 

I n = inf /(e p )(6 n -A ? n ) + 0(6 2 +6 n |A > n |)+o a . s .[^/ 2 (/?)/n] 
po<p<pi 

>i inf f(Qb n 

P0<P<Pl 



BAHADUR REPRESENTATION 



27 



almost surely. By (57) of Lemma 15, II n = o a . s .(6 n ) and hence (59) holds. 
Relation (60) follows by letting y = £ njP = £ p + A„ jP in (ii) of Lemma 15 in 
view of 

sup |F(£ p + A„ iP ) -p-/(£p)A„ iP | 

P0<P<P1 

< ^ SU P A n,p = Oa.s.(6„) 

and sup po < p < pi |/(£ p + A n>p ) - /(£ p )| = o a . s .(Z> n )- □ 

Remark 12. Under the stronger condition that f e is four times dif- 
ferentiable with bounded, continuous and integrable derivatives, Ho and 
Hsing [17] obtained 

(61) sup |A njP - X n \ = o a . s .(n~ 1 ~ A cr nj i) 

Po<p<pi 

for all < A < min(l — /?,/? — 1/2); see Theorem 5.1 therein. The result (61) 
is very interesting in the sense that A„ iP can be approximated by X n , 
which does not depend on p. Consequently the asymptotic distribution of 
the trimmed and Winsorized means easily follows from that of X n . After ele- 
mentary calculations it is easily seen that our bound (60) is slightly sharper. 

Proof of Theorem 3. By (59) sup po < p < pi | A„ iP | = o a . s .(& n )- Applying 
Lemma 15 with x = £ p and y = £„ jP , p$ < p < pi, we have 

n sup \ p -F^ p + A n ^ + f(^ p )X n -[F n ^ p )-F(Q + f(^)X n }\ 

P0<P<P1 

(62) 

= O a . s . Wnb n logn + bnAl/ 2 ^)} . 
Since sup x [|/'(a;)| + |/"(x)|] < oo, by Taylor's expansion 

sup \F(C P + A n , p ) -p- A n , p /(e p ) - Al p f'(Q/2\=o a . s .(b 3 n ) 

P0<P<Pl 

and 

sup |/(£p + A n , p )-/(£ p )- A n , p /%)| = o a . s .(b 2 n ). 

P0<P<Pl 

After some elementary calculations, (62) implies 



sup 

p <p<Pl 



/&>) A n , p + ^(A n , p - X n f - \f\QXl - [p - F n (Q] 



o a .s. (b 3 n ) + n 1 O a ,. s . Wnb n logn + b n A}/ 2 (/?)] . 
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Observe that = 0[^EL*{n) + n 2 ~ 2li L 2 (n)\ and A 1 J 2 (I3) < ^„(log?i) 3 / 2 x 
(log log Tij — o{ribji) . Thus (15) follows from (60) and 

sup (A n , p - X n ) 2 = o a . s . [b 2 n + A)! 2 {P)/n\ 2 

P0<P<P1 

= o a . s .[b 4 n + A n (P)/n 2 } 

= o a . s .[b 3 n + b n A 1 n / 2 (P)/n]. □ 

7.1. The sharpness of Theorem 3. It is challenging to obtain a sharp 
bound for the left-hand side of (15) in Theorem 3. We now comment on 
the sharpness of Lemma 15, which describes the oscillations of F n (x) — 
F(x) + f( x )X n . Recall that in the SRD case the sharp oscillation rate of 
F n {x) — F(x) at a fixed x in Lemma 12 leads to the Bahadur representation 
with optimal bound by letting b n = C\J (log log n)/n for some c > 0. Here we 
claim that the bound in (57) of Lemma 15, which is a key ingredient for the 
derivation of (15), is optimal up to a multiplicative slowly varying function. 

Lemma 17. Assume E(e^) < oo ; (14) and / R \f'J(u)\ 2 du < oo. Let 5 n = 
n y L,2(n) for some slowly varying function L2, — 1 < 7 < and a n p, = n 

(i) If4f3- 3 > 7, then [S n (x + S n ; 1) - S n (x; l)]/^=> N[0, f(x)}. 

(ii) If 4/3 - 3 < 7, t/ien 

S n (x + 5 n ;l) - S n (x;l) 
O~n,20~ n 

(63) x 

^f'{x)C p j [ [{v-u 1 ) + (v-U2) + ]-^dvdM(u 1 )dM(u2) 

Jui<u 2 <l JO 

for some constant Cp > 0, where M is a standard two-sided Brownian motion 
and z + = max(z,0). In particular, if 7 = 1/2 — (3, then (i) [resp. (ii)] holds 
j/7/10</3<l [resp. 1/2 < < 7/10]. 

Remark 13. The limiting distribution in (63) is called the Rosenblatt 
distribution, a special case of multiple Wiener-Ito integrals [23]. 

Proof of Lemma 17. Observe that 

S n (x + 5 n ; 1) - S n (x; 1) = n[M n (x + S n ) - M n {x)\ + [H n (x + 5 n ) - H n {x)\. 

Write n[F n {x + 5 n ) -F n (x)] = £™ =1 K [(x-Xi)/8 n ], where the kernel = 
l_i<u<o- By Lemma 2 in [34] n[M n (x + 5 n ) - M n (x)]/V^dn^ N[0,a 2 (x)] 
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with a 2 (x) = f(x) J R K 2 (u) du = f (x) . By Lemma 14 



\H n {x + 5 n ) - H n (x)\\ < 5 r , 



sup \h n (y)\ 



+ n 2 - 2 ^L 2 (n)]. 



= 0(5 n y n ) = 5 n O[V^L*{n 

If 4/3 — 3 > 7, then (Jn^n = o(y/n5 n ) and (i) follows. 

On the other hand, if 4/3 — 3 < 7, then /? E (1/2,3/4) and h n (x)/a n> 2 
converges to the Rosenblatt distribution in (63); see Lemma 4 in [34] and 
Corollary 3 in [31]. Under the conditions (14) and / R \f"(u)\ 2 du < 00, by the 
argument of Lemma 14, we have || sup u \h' n (u)\ \\ = 0(\P n ). Then \\H n (x + 
5 n ) - H n (x) - 5 n h n (x)\\ < ±<5 2 || sup u |/^(tt)||| = 0(5 2 W n ) and (ii) follows in 
view of y/n6^ + <5^„ = o(5 n a n , 2 ). 

If 7 = 1/2 -fi, then 4/3 - 3 > 7 if and only if 7/10 < 0. □ 

Lemma 17 asserts the dichotomous convergence of S n (x + 5 n ; 1) — S n (x; 1) 
at a fixed point x. Notice that A > n /[n 1 / 2_/3 L(?i)] =^/V(0,ct 2 ) and, by (60), 
{£n,p-£ P )/[n 1/2 -PL(n)} => N{0,a 2 ) for some a 2 < 00. For 6 n = n 1 / 2 -l 3 L 2 (n), 
Lemma 17 shows that, up to a multiplicative slowly varying function, the 
optimal bound of [S n (x + 5 n ; 1) - S n (x; l))/n is n ^(-/3/2-i/4, 3/2-3/3) _ TMg 
bound indicates that (15) or (16) is optimal up to a multiplicative slowly 
varying function. It also explains why there is a boundary (3 = 7/10 in 
(15) or (16); see the discussion of the three terms in the O a s . bound of (15) 
in Section 3. 
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